Comparing auditory distance perception in real and virtual environments and the role of the loudness cue: A study based on event-related potentials.

The perception of the distance to a sound source is relevant in many everyday situations, not only in real spaces, but also in virtual reality (VR) environments. Where real rooms often reach their limits, VR offers far-reaching possibilities to simulate a wide range of acoustic scenarios. However, in virtual room acoustics a plausible reproduction of distance-related cues can be challenging. In the present study, we compared the detection of changes of the distance to a sound source and its neurocognitive correlates in a real and a virtual reverberant environment, using an active auditory oddball paradigm and EEG measures. The main goal was to test whether the experiments in the virtual and real environments produced equivalent behavioral and EEG results. Three loudspeakers were placed at ego-centric distances of 2 m (near), 4 m (center), and 8 m (far) in front of the participants (N = 20), each 66 cm below their ear level. Sequences of 500 ms noise stimuli were presented either from the center position (standards, 80 % of trials) or from the near or far position (targets, 10 % each). The participants had to indicate a target position via a joystick response ("near" or "far"). Sounds were emitted either by real loudspeakers in the real environment or rendered and played back for the corresponding positions via headphones in the virtual environment. In addition, within both environments, loudness of the auditory stimuli was either unaltered (natural loudness) or the loudness cue was manipulated, so that all three loudspeakers were perceived equally loud at the listener's position (matched loudness). The EEG analysis focused on the mismatch negativity (MMN), P3a, and P3b as correlates of deviance detection, attentional orientation, and context-updating/stimulus evaluation, respectively. Overall, behavioral data showed that detection of the target positions was reduced within the virtual environment, and especially when loudness was matched. Except for slight latency shifts in the virtual environment, EEG analysis indicated comparable patterns within both environments and independent of loudness settings. Thus, while the neurocognitive processing of changes in distance appears to be similar in virtual and real spaces, a proper representation of loudness appears to be crucial to achieve a good task performance in virtual acoustic environments.

Manipulating objects during learning shrinks the global scale of spatial representations in memory: a virtual reality study.

Goal-directed approaches to perception usually consider that distance perception is shaped by the body and its potential for interaction. Although this phenomenon has been extensively investigated in the field of perception, little is known about the effect of motor interactions on memory, and how they shape the global representation of large-scale spaces. To investigate this question, we designed an immersive virtual reality environment in which participants had to learn the positions of several items. Half of the participants had to physically (but virtually) grab the items with their hand and drop them at specified locations (active condition). The other half of the participants were simply shown the items which appeared at the specified position without interacting with them (passive condition). Half of the items used during learning were images of manipulable objects, and the other half were non manipulable objects. Participants were subsequently asked to draw a map of the virtual environment from memory, and to position all the items in it. Results show that active participants recalled the global shape of the spatial layout less precisely, and made more absolute distance errors than passive participants. Moreover, global scaling compression bias was higher for active participants than for passive participants. Interestingly, manipulable items showed a greater compression bias compared to non-manipulable items, yet they had no effect on correlation scores and absolute non-directional distance errors. These results are discussed according to grounded approaches of spatial cognition, emphasizing motor simulation as a possible mechanism for position retrieval from memory.

The visual perception of long outdoor distances.

Many previous studies have investigated visual distance perception, especially for small to moderate distances. Few experiments, however, have evaluated the perception of large distances (e.g., 100 m or more). The studies that have been conducted have found conflicting results (diametrically opposite conclusions). In the current experiment, the functions relating actual and perceived distance were obtained for sixteen adult observers using the method of equal appearing intervals. These functions relating perceived and actual distance were obtained for outdoor viewing in a typical University environment-the experiment was conducted along a sidewalk adjacent to a typical street where campus buildings, trees, street signs, etc., were visible. The overall results indicated perceptual compression of distances in depth so that the stimulus distance intervals appeared significantly shorter than the actual (physical) distance intervals. It is important to note, however, that there were sizeable individual differences-the judgments of half of the observers were relatively accurate, whereas the judgments of the remaining half were inaccurate to varying degrees. The results of the experiment demonstrate that there is no single function that describes how human observers visually perceive large distance intervals in outdoor environments.

Internal representations of the canonical real-world distance of objects.

In the real world, every object has its canonical distance from observers. For example, airplanes are usually far away from us, whereas eyeglasses are close to us. Do we have an internal representation of the canonical real-world distance of objects in our cognitive system? If we do, does the canonical distance influence the perceived size of an object? Here, we conducted two experiments to address these questions. In Experiment 1, we first asked participants to rate the canonical distance of objects. Participants gave consistent ratings to each object. Then, pairs of object images were presented one by one in a trial, and participants were asked to rate the distance of the second object (i.e., a priming paradigm). We found that the rating of the perceived distance of the target object was modulated by the canonical real-world distance of the prime. In Experiment 2, participants were asked to judge the perceived size of canonically near or far objects that were presented at the converging end (i.e., far location) or the opening end (i.e., near location) of a background image with converging lines. We found that regardless of the presentation location, participants perceived the canonically near object as smaller than the canonically far object even though their retinal and real-world sizes were matched. In all, our results suggest that we have an internal representation of the canonical real-world distance of objects, which affects the perceived distance of subsequent objects and the perceived size of the objects themselves.

Comparison of peripersonal space in front and rear spaces.

The space immediately around the body, referred to as the peripersonal space (PPS), plays a crucial role in interactions with external objects and in avoiding unsafe situations. This study aimed to investigate whether the size of the PPS changes depending on direction, with a particular focus on the disparity between the front and rear spaces. A vibrotactile stimulus was presented to measure PPS while a task-irrelevant auditory stimulus (probe) approached the participant. In addition, to evaluate the effect of the probe, a baseline condition was used in which only tactile stimuli were presented. The results showed that the auditory facilitation effect of the tactile stimulus was greater in the rear condition than in the front condition. Conversely, the performance on tasks related to auditory distance perception and sound speed estimation did not differ between the two directions, indicating that the difference in the auditory facilitation effect between directions cannot be explained by these factors. These findings indicate that the strength of audio-tactile integration is greater in the rear space compared to the front space, suggesting that the representation of the PPS differed between the front and rear spaces.

The contribution of semantic distance knowledge to size constancy in perception and grasping when visual cues are limited.

To achieve a stable perception of object size in spite of variations in viewing distance, our visual system needs to combine retinal image information and distance cues. Previous research has shown that, not only retinal cues, but also extraretinal sensory signals can provide reliable information about depth and that different neural networks (perception versus action) can exhibit preferences in the use of these different sources of information during size-distance computations. Semantic knowledge of distance, a purely cognitive signal, can also provide distance information. Do the perception and action systems show differences in their ability to use this information in calculating object size and distance? To address this question, we presented 'glow-in-the-dark' objects of different physical sizes at different real distances in a completely dark room. Participants viewed the objects monocularly through a 1-mm pinhole. They either estimated the size and distance of the objects or attempted to grasp them. Semantic knowledge was manipulated by providing an auditory cue about the actual distance of the object: "20 cm", "30 cm", and "40 cm". We found that semantic knowledge of distance contributed to some extent to size constancy operations during perceptual estimation and grasping, but size constancy was never fully restored. Importantly, the contribution of knowledge about distance to size constancy was equivalent between perception and action. Overall, our study reveals similarities and differences between the perception and action systems in the use of semantic distance knowledge and suggests that this cognitive signal is useful but not a reliable depth cue for size constancy under restricted viewing conditions.

Bionic study of distance-azimuth discrimination of multi-scattered point objects in bat bio-sonar.

This paper presents a novel approach to enhance the discrimination capacity of multi-scattered point objects in bat bio-sonar. A broadband interferometer mathematical model is developed, incorporating both distance and azimuth information, to simulate the transmitted and received signals of bats. The Fourier transform is employed to simulate the preprocessing step of bat information for feature extraction. Furthermore, the bat bio-sonar model based on convolutional neural network (BS-CNN) is constructed to compensate for the limitations of conventional machine learning and CNN networks, including three strategies: Mix-up data enhancement, joint feature and hybrid atrous convolution module. The proposed BS-CNN model emulates the perceptual nerves of the bat brain for distance-azimuth discrimination and compares with four conventional classifiers to assess its discrimination efficacy. Experimental results demonstrate that the overall discrimination accuracy of the BS-CNN model is 93.4%, surpassing conventional CNN networks and machine learning methods by at least 5.9%. This improvement validates the efficacy of the BS-CNN bionic model in enhancing the discrimination accuracy in bat bio-sonar and offers valuable references for radar and sonar target classification.

Temporal features of size constancy for perception and action in a real-world setting: A combined EEG-kinematics study.

A stable representation of object size, in spite of continuous variations in retinal input due to changes in viewing distance, is critical for perceiving and acting in a real 3D world. In fact, our perceptual and visuo-motor systems exhibit size and grip constancies in order to compensate for the natural shrinkage of the retinal image with increased distance. The neural basis of this size-distance scaling remains largely unknown, although multiple lines of evidence suggest that size-constancy operations might take place remarkably early, already at the level of the primary visual cortex. In this study, we examined for the first time the temporal dynamics of size constancy during perception and action by using a combined measurement of event-related potentials (ERPs) and kinematics. Participants were asked to maintain their gaze steadily on a fixation point and perform either a manual estimation or a grasping task towards disks of different sizes placed at different distances. Importantly, the physical size of the target was scaled with distance to yield a constant retinal angle. Meanwhile, we recorded EEG data from 64 scalp electrodes and hand movements with a motion capture system. We focused on the first positive-going visual evoked component peaking at approximately 90 ms after stimulus onset. We found earlier latencies and greater amplitudes in response to bigger than smaller disks of matched retinal size, regardless of the task. In line with the ERP results, manual estimates and peak grip apertures were larger for the bigger targets. We also found task-related differences at later stages of processing from a cluster of central electrodes, whereby the mean amplitude of the P2 component was greater for manual estimation than grasping. Taken together, these findings provide novel evidence that size constancy for real objects at real distances occurs at the earliest cortical stages and that early visual processing does not change as a function of task demands.

Interpersonal distance perception during the normalization of an pandemic situation: Effects of mask-wearing and vaccination.

This study aimed to evaluate the effect of anti-pandemic measures, including wearing a face mask and receiving vaccinations, on interpersonal distance (IPD) during the normalization stage of the COVID-19 pandemic. Virtual reality (VR) technology was used to simulate the experimental environment and a confederate in different conditions. Thirty-one participants were asked to approach the virtual confederate, who could exhibit three vaccination states and two mask-wearing conditions, actively and passively in both indoor and outdoor environments. ANOVA results showed that the participants kept a smaller IPD from the confederate wearing a face mask (IPD = 125.6 cm) than from the one without a face mask (IPD = 154.2 cm). The effects of vaccination states were significant, with the largest distance for an unvaccinated confederate (IPD = 182.3 cm) and the smallest distance for the confederate who had received a booster vaccine (IPD = 111.5 cm). Significant effects of environment were also found, with the participants maintaining a larger IPD in an outdoor environment (IPD = 143.4 cm) than in an indoor room (IPD = 136.4 cm). Additionally, the IPD collected when the participants were passively approached (IPD = 149.6 cm) was significantly larger than that obtained when they actively approached the confederate (IPD = 130.3 cm). Moreover, when the participants faced a confederate who had received a booster vaccine and wore a mask, the IPD was not significantly different from that collected before the COVID-19 pandemic in both the active and passive patterns. These findings help us to better understand the nature of IPD and human behaviors during the normalization stage of the pandemic and provide scientific suggestions for policymakers to develop pandemic-prevention measures.

Integral Imaging Display System Based on Human Visual Distance Perception Model.

In an integral imaging (II) display system, the self-adjustment ability of the human eye can result in blurry observations when viewing 3D targets outside the focal plane within a specific range. This can impact the overall imaging quality of the II system. This research examines the visual characteristics of the human eye and analyzes the path of light from a point source to the eye in the process of capturing and reconstructing the light field. Then, an overall depth of field (DOF) model of II is derived based on the human visual system (HVS). On this basis, an II system based on the human visual distance (HVD) perception model is proposed, and an interactive II display system is constructed. The experimental results confirm the effectiveness of the proposed method. The display system improves the viewing distance range, enhances spatial resolution and provides better stereoscopic display effects. When comparing our method with three other methods, it is clear that our approach produces better results in optical experiments and objective evaluations: the cumulative probability of blur detection (CPBD) value is 38.73%, the structural similarity index (SSIM) value is 86.56%, and the peak signal-to-noise ratio (PSNR) value is 31.12. These values align with subjective evaluations based on the characteristics of the human visual system.

Monocular information for perceiving large egocentric distance: A comparison between monocularly blind patients and normally sighted observers.

The debate surrounding the advantages of binocular versus monocular vision has persisted for decades. This study aimed to investigate whether individuals with monocular vision loss could accurately and precisely perceive large egocentric distances in real-world environments, under natural viewing conditions, comparable to those with normal vision. A total of 49 participants took part in the study, divided into three groups based on their viewing conditions. Two experiments were conducted to assess the accuracy and precision of estimating egocentric distances to visual targets and the coordination of actions during blind walking. In Experiment 1, participants were positioned in both a hallway and a large open field, tasked with judging the midpoint of self-to-target distances spanning from 5 to 30 m. Experiment 2 involved a blind walking task, where participants attempted to walk towards the same targets without visual or environmental feedback at an unusually rapid pace. The findings revealed that perceptual accuracy and precision were primarily influenced by the environmental context, motion condition, and target distance, rather than the visual conditions. Surprisingly, individuals with monocular vision loss demonstrated comparable accuracy and precision in perceiving egocentric distances to that of individuals with normal vision.

Targeted reaching with monocular depth information and haptic feedback: Comparing between monocular patients and normally sighted observers.

Monocular blindness impairs visual depth perception, yet patients seldom report difficulties in targeted actions like reaching, walking, or driving. We hypothesized that by utilizing monocular depth information and calibrating actions with haptic feedback, monocular patients can perceive egocentric distance and perform targeted actions. We compared targeted reaching in monocular patients, monocular-viewing, and binocular-viewing normal controls. Sixty observers reached either a far or a near target, calibrating reaches to the near target with accurate or false feedback while leaving reaches to the far target uncalibrated. Reaching accuracy and precision were analyzed. Results indicated no difference in reaching accuracy between monocular patients and normal controls; all groups initially underestimated distances before until calibration. Monocular patients responded to calibration sensitively, achieving accuracy in calibrated reaches and generalizing this effect to uncalibrated distances. Thus, with monocular depth information and haptic feedback, monocular patients could perceive distance and accomplish targeted reaching.

Visual perception of travel distance for self-motion through crowds.

Humans can use visual motion to estimate the distance they have traveled. In static environments, optic flow generated by self-motion provides a pattern of expanding motion that is used for the estimation of travel distance. When the environment is populated by other people, their biological motion destroys the one-to-on correspondence between optic flow and travel distance. We investigated how observers estimate travel distance in a crowded environment. In three conditions, we simulated self-motion through a crowd of standing, approaching, or leading point-light walkers. For a standing crowd, optic flow is a veridical signal for distance perception. For an approaching crowd, the visual motion is the sum of the self-motion-induced optic flow and the optic flow produced by the approaching walkers. If only optic flow were to be used, travel distance estimates would be too high because of the approaching direction of the crowd toward the observer. If, on the other hand, cues from biological motion could be used to estimate the speed of the crowd, then the excessive optic from the approaching crowd flow might be compensated. In the leading crowd condition, in which walkers of the crowd keep their distance from the observer as they walk along with the observer, no optic flow is produced. In this condition, travel distance estimation would have to rely solely on biological motion information. We found that distance estimation was quite similar across these three conditions. This suggests that biological motion information can be used (a) to compensate for excessive optic flow in the approaching crowd condition and (b) to generate distance information in the leading crowd condition.

Non-metric distance judgements are influenced by image projection geometry and field of view.

Despite its mathematical simplicity and ubiquity in imaging technology, there has long been doubt about the ability of linear perspective to best represent human visual space, especially at wide-angle fields of view under natural viewing conditions. We investigated whether changes to image geometry had an impact on participants' performance, specifically in terms of non-metric distance estimates. Our multidisciplinary research team developed a new open-source image database to study distance perception in images by systematically manipulating target distance, field of view, and image projection using non-linear natural perspective projections. The database consists of 12 outdoor scenes of a virtual three-dimensional urban environment in which a target ball is presented at increasing distance, visualised using both linear perspective and natural perspective images, rendered, respectively, with three different fields of view: 100°, 120°, and 140° horizontally. In the first experiment (N = 52), we tested the effects of linear versus natural perspective on non-metric distance judgements. In the second experiment (N = 195), we investigated the influence of contextual and previous familiarity with linear perspective, and individual differences in spatial skills on distance estimations. The results of both experiments showed that distance estimation accuracy improved in natural compared with linear perspective images, particularly at wide-angle fields of view. Moreover, undertaking a training session with only natural perspective images led to more accurate distance judgements overall. We argue that the efficacy of natural perspective may stem from its resemblance to the way objects appear under natural viewing conditions, and that this can provide insights into the phenomenological structure of visual space.

Distance Perception in Virtual Reality: A Meta-Analysis of the Effect of Head-Mounted Display Characteristics.

Distances are commonly underperceived in virtual reality (VR), and this finding has been documented repeatedly over more than two decades of research. Yet, there is evidence that perceived distance is more accurate in modern compared to older head-mounted displays (HMDs). This meta-analysis, based on 137 samples from 61 publications, describes egocentric distance perception across 20 HMDs and examines the relationship between perceived distance and technical HMD characteristics. Judged distance was positively associated with HMD field of view (FOV), positively associated with HMD resolution, and negatively associated with HMD weight. The effects of FOV and resolution were more pronounced among heavier HMDs. These findings suggest that future improvements in these technical characteristics may be central to resolving the problem of distance underperception in VR.

Skin stretch modulates tactile distance perception without central correction mechanisms.

Tactile distance perception is influenced by stimulus orientation. On the hands or face, effects of orientation may originate from the mostly oval shape of receptive fields (RF) of which the long axis aligns with the proximodistal body axis. As tactile distance estimation relies on the number of RFs between stimuli, their alignment leads to a distortion of perception with distances being perceived as shorter in the proximodistal than the mediolateral body axis. It is however unknown, how physical manipulations such as skin stretch affect distance perception. Participants judged which of two distances aligned with the mediolateral or proximodistal axis on their dorsal dominant hand felt larger in two conditions: without physical manipulation and with proximodistal skin stretch. Distances were perceived shorter in proximodistal direction in both the nonstretch and the stretch condition, which was significantly pronounced in the stretch condition. Skin stretch led to perception of tactile distances as smaller, possibly related to the removal of afferent nerve endings and corresponding somatosensory RFs in the same external reference frame between the two touches. Though skin stretch is represented centrally, our results likely show that no correctional top-down mechanism corrects for skin stretch when estimating tactile distances. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Perceiving distance in virtual reality: theoretical insights from contemporary technologies.

Decades of research have shown that absolute egocentric distance is underestimated in virtual environments (VEs) when compared with the real world. This finding has implications on the use of VEs for applications that require an accurate sense of absolute scale. Fortunately, this underperception of scale can be attenuated by several factors, making perception more similar to (but still not the same as) that of the real world. Here, we examine these factors as two categories: (i) experience inherent to the observer, and (ii) characteristics inherent to the display technology. We analyse how these factors influence the sources of information for absolute distance perception with the goal of understanding how the scale of virtual spaces is calibrated. We identify six types of cues that change with these approaches, contributing both to a theoretical understanding of depth perception in VEs and a call for future research that can benefit from changing technologies. This article is part of the theme issue 'New approaches to 3D vision'.

From pictures to reality: modelling the phenomenology and psychophysics of 3D perception.

The dominant inferential approach to human 3D perception assumes a model of spatial encoding based on a physical description of objects and space. Prevailing models based on this physicalist approach assume that the visual system infers an objective, unitary and mostly veridical representation of the external world. However, careful consideration of the phenomenology of 3D perception challenges these assumptions. I review important aspects of phenomenology, psychophysics and neurophysiology which suggest that human visual perception of 3D  objects and space is underwritten by distinct and dissociated spatial encodings that are optimized for specific regions of space. Specifically, I argue that 3D perception is underwritten by at least three distinct encodings for (1) egocentric distance perception at the ambulatory scale, (2) exocentric distance (scaled depth) perception optimized for near space, and (3) perception of object shape and layout (unscaled depth). This tripartite division can more satisfactorily account for the phenomenology, psychophysics and adaptive logic of human 3D perception. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Familiar size affects perception differently in virtual reality and the real world.

The promise of virtual reality (VR) as a tool for perceptual and cognitive research rests on the assumption that perception in virtual environments generalizes to the real world. Here, we conducted two experiments to compare size and distance perception between VR and physical reality (Maltz et al. 2021 J. Vis. 21, 1-18). In experiment 1, we used VR to present dice and Rubik's cubes at their typical sizes or reversed sizes at distances that maintained a constant visual angle. After viewing the stimuli binocularly (to provide vergence and disparity information) or monocularly, participants manually estimated perceived size and distance. Unlike physical reality, where participants relied less on familiar size and more on presented size during binocular versus monocular viewing, in VR participants relied heavily on familiar size regardless of the availability of binocular cues. In experiment 2, we demonstrated that the effects in VR generalized to other stimuli and to a higher quality VR headset. These results suggest that the use of binocular cues and familiar size differs substantially between virtual and physical reality. A deeper understanding of perceptual differences is necessary before assuming that research outcomes from VR will generalize to the real world. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Aging and the visual perception of object size.

An experiment evaluated the ability of 30 younger and older adults to visually judge object size under three conditions: (1) full cue, (2) in the dark, with linear perspective, and (3) in complete darkness. Each observer made repeated judgments for the same square stimuli (the task was to adjust a separation until it matched the perceived size of the squares), enabling an evaluation of precision as well as accuracy. The judgments were just as accurate in the dark with linear perspective condition as in the full cue condition, indicating that linear perspective serves as an important source of optical information to support the perception of object size). In contrast, in complete darkness (where linear perspective information was unavailable), the accuracy of the observers' judgments was poor. Finally, there was no difference in either the accuracy or the precision of the observers' judgments between the two age groups, despite the fact that the older adults were more than 50 years older than the younger adults (mean age of the younger and older adults was 22.3 and 74.1 years, respectively). The ability to visually perceive object size is well maintained with increasing age, unlike a number of other important visual abilities.